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ABSTRACT 


Training area selection and refinement is considered to be an important part of the 
supervised classification procedure, as it affects the overall classification accuracy of the 
classifier. Obtaining a representative class accurately and efficiently has been the major 
goal of this study, which has been attempted by the refinement of traditional data and by 
applying alternate methods of training area selection.. 

A novel technique, termed the seed pixel method, of training area delineation was 
attempted as a means for improving both the efficiency and consistency of training field 
extraction for images with high resolution and high spectral variability. It was designed to 
increase the degree of automation of training field extraction, thereby significantly 
reducing analyst time requirements, while maintaining acceptable levels of accuracy. It is 
viewed as a potential replacement to other non-traditional image analysis techniques. This 
algorithm gave 100% training area accuracies and better test area accuracies in 
heterogeneous classes as compared to the traditional approach. 

The basic approach used in the thesis was to apply two levels of classification strategies, 
one by classifying the images by selecting training areas by conventional methods and by 
seed jlixel method. And the second, by classifying the images after refinement suggested 
by Buttner et al. (1988) and Mather (1987). These refinement procedures have shown 
to improve the accuracies of classification. 
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Chapter 1 


INTRODUCTION 


1. 1 Background of the Thesis 

Automatic classification of the pixels making up a remotely-sensed image involves 
associating each pixels in the image with a label describing a real world object. It is a 
problem of recognition in which the numerical values associated with each pixel are 
required to be identified in terms of observable geographical, geological or other earth 
.surface cover type. This labeling operation, when carried out for all pixels in the 
arett, results in a thematic map showing the geographical distribution of a 
'thente* such as vegetation or water quality. A classified remotely-sensed image is 
thus a form of a digital thematic map. 

Spectral training is one of the most substantial barriers to traditional supervised 
parametric land cover classification. Analysts must laboriously develop a new set of 
training statistic.s for each new satellite image. The retraining is tedious, time 
consuming, expensive, and requires a trained image analyst. 

Each information class of interest asually contains significant spectral variation, 
requiring several spectral subclasses for each class. This results in a large amount of 
processing time for a satellite image. 



Research iiHiicatcs thal flic common manual training techniques are inadequate, not 
only hctaysc of tfic analyst time requirements, but also because of incomplete 
intoinuuion c\tiactii>n from current generation satellite imageiy (Bolstad and 
Lillesaiid. IdKd). I he accuracy ol classitication mainly depends on the quality of 
training rather than the applied statistical algorithm (Hixson et al, 1980). While a 
considerable effort has been devoted to the analysis of the performance of 
classification algorithms for use with remotely sensed multispectral images, 
relatively little attention ha.s been focussed on the need to provide algorithms 
that would extract adequate and representative training data. The inclusion of non- 
represeniali\c pixels, in the training data, particularly in a heterogeneous environment, 
can .seriously distort the sample statistics and hence the performance of the classifier. 

Compared to imagery from fmst generation systems such as the Landsat MSS, 
current satellite have better spectral, spatial and radiometric resolution. For sensors with 
better .spatial resolution, there will be many .sub-classes in a single land use class, more 
overlapping between classes and thus less statistical separability between them. The 
tremendous spatial and spectral complexity of second generation data can make it 
extremely difficult and tedious both to locate and delineate spectrally homogeneous 
training fields. This is compounded by the need to ensure that all important subclasses 
within the high-variability data have been adequately characterized spectrally or even 
.sampled at all (Aral, 1992). Because of these data induced changes, the application of 
traditional techniques to second generation satellite imagery requires a much greater time 
and expertise in order to produce accurate and repeatable classification results than has 
been typically the case with coarser, first generation data. And thus arises the need for 
evolving new and improved techniques for training area selection and purification. 
Therefore it is important that a representative training data be selected for feature 
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classitication in tfie image. This particular aspect was the prime motivation for 
investigating some improved methods of training area definition and their application for 
the classification of digital remotely sensed imagery. 


1.2 Thesis Objectives 

The investigations in this thesis have been motivated by two main hypotheses: 
Hypothesis I 

The clas.sification accuracy of high resolution scenes can be improved by seed pixel 
training area selection approach. This hypothesis underlines the first objective of the 
thesis. 

Objective 1 

To evaluate the extent to which seed pixel algorithm for training area selection alleviate 
the classification problem. 

Hypothesis II 

Refinement of training area can improve the accuracy of classification. This 
hypothesis leads to the second and final objective of the thesis. 
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Objective O 


To investigate some methoeis of training area refinement and to assess their significance in 
improving the classification accuracy. 


1.3 Overview of Data Resources, Study Sites and Methodology 


The study lias been conducted on two study sites. The first is the Singrauli mines area in 
Sidhi di.strict and the .second is Bhopal city area, both in Madhya Pradesh (India). The four 
band Indian Remote Sensing Satellite (IRS) data have been obtained from National 
Remote Sensing Agency (NRSA), Hyderabad, India. The LISS2 IRS camera of the 
.satellite operates in four band widths (0.45-0.52, 0.52-0.59, 0.62-0.68, 0.77-0.86 
micrometers) with a spatial resolution 36.25m and a radiometric resolution of 7 bits per 
pixel. For defining training areas and testing the accuracies of final results, topographic 
maps (number 63 U1 1 , 63 L/12, 63 L/16, 1970 for Singrauli area and number 55 E/7 and 
55 E/H, 1974 for Bhopal area) with a scale of 1:50000, published by the Survey of India, 
have been used. 

The semi-natural environment of Singrauli area consists of five prominent classes. These 
are rocky terrain, dense forest, vegetation, water and mine dumps. The semi-urban 
environment of Bhopal city consists of five prominent classes. These are built-up area, 
open scrub/vegetation, marsh, forests and lake water. 

The basic approach used in the thesis is to apply different training area extraction 
strategies, on study site images and to generate classification products. These products are 
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then cimiparcd to the test areas to compute classification accuracies. The investigation has 
involved writing computer programs. The list of main programs, which have been written 
in C hinguage and with the help of Starbase Graphics libraries, have been given in 
Apjxmdix. 


1.4 Thesis Organization 

Chapter 2 describes the Maximum Likelihood Classification and the training area 
extraction prtKedures with the traditional and improved methods. In Chapter 3, results of 
the ex|Terinients performed on imagery of Singrauli and Bhopal test area presented. 
Chapter 4 gives the concluding remarks with respect to the methods applied and the 
future perspective of training area refinement and extraction. 
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Chapter 2 


TRAINING AREA EXTRACTION IN IMAGE 

CLASSIFICATION 


2.1 Objective 

In this chapter the theoretical background to per-pixel classification using supervised and 
unsupervised classification methods is presented with emphasis on supervised 
classification using maximum likelihood method. The choice of this algorithm is motivated 
by its proven performance for automatic classification of remotely-sensed images (Swain 
and Davis, 1978). The theoretical discussion is followed by a discussion on the various 
training urea extraction methods and their limitations. 

The objectives of the chapter are: 

• To develop an understanding of the importance of ‘good’ training area selection in the 
per-pixel classification of the remotely-sensed imagery. 

• To introduce an alternative approach for training area selection. 

• To study some methods of training area refinement. 



2.2 Supervised Image Classification 


2.2.1 Overview 

There are two types of image classification techniques supervised and unsupervised. In the 
supervised approach the user defines useful information categories and then examines their 
.spectral separability whereas in the unsupervised approach he first determines spectrally 
separable clas.ses and then defines their information utility. 

In the supervised classification approach 'the image analyst supervises the pixel 
categorization process by specifying to the computer algorithm, numerical descriptors of 
the various land cover types, called training areas or training sites, are used to compile a 
numerical interpretation key that describes the spectral attributes for each feature type of 
interest. Each pixel in the data set is then compared numerically to each category it looks 
most alike' (Lillesand and Keifer, 1987). 

Generally, three algorithms are used for supervised classification: minimum-distance-to- 
means, parallelepiped, and Guassian maximum likelihood(ML) (Lillesand and Keifer, 
1987). The minimum-distance-to-mean strategy is mathematically simple and 
computationally efficient but is insensitive to different degrees of variance or covariance 
in the spectral response of the training pixels. The parallelepiped classification strategy is 
also computationally simple and takes into account the variance in training classes but 
problems may arise from parallelepiped overlap due to correlation amongst classes. The 
Gaussian ML classifier quantitatively evaluates both the variance and covariance of the 
training class pixels and assumes a normal distribution for training classes. Of the three 
classifiers, the ML classifier has been most widely used. Hence, it has been selected in this 
study for supervised classification. 
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2.2.2 Maximum Likelihood Classification 


Gaussian ML classifier quantitatively evaluates both the variance and covariance of 
training class pixels and assumes a normal distribution of training classes. This classifier is 
a parametric classifier which relies on specifying the probability distribution of class 
values by a representative function. In this case the function is Gaussian and the mean and 
covariance its parameters. The mean vector in multidimensional space locates the single 
peak of the unimodal probability distribution and the covariance specifies the region of 
influence of that probability distribution in each dimension. The classifier uses a parametric 
statistical covariance to prepare the probability density distribution function for each 
individual class and then employs Bayes' optimal strategy to maximize the likelihood of 
correct classification when allocating every pixel within the data set to one of the user 
specified classes. The user then decides upon an acceptable level of likelihood for each 
class and permits only those pixels above this level to be accepted into a final classification 
product. It is always assumed that prior to invoking the classifier the user has specified 
representative homogeneous training areas that permit an n-dimensional multivariate 
normal probability function to be constituted for each class. A more detailed discussion on 
the normal distribution is given by Hand (1981). 

Since the normal distribution provides for good approximation for many naturally 
occurring phenomenon, a large amount of statistical theory has been based on it. It has 
been observed that a multivariate assumption holds well for the probabilistic processes 
observed in a large number of remote sensing applications. Also, classifiers designed on 
this basis are robust in the sense that classification is not very sensitive to even moderately 
severe violations of this assumption. From a practical point of view, experiments with 
more and less complex classifiers have shown that the normal assumption u.sually 
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provides a good trade-off between classification performance (accuracy) and cost (speed 
and compIexity)(Swain and Davis, 1978). 

In choosing the normal distribution for the ML classifier, two conditions must be 
satisfied. Firstly, the original data distribution should be unimodal and secondly, there 
should be an adequate number of training samples represented by a unimodal probability 
density distribution. The second major constraint is related to the need for an adequate 
number of training .samples to be included in the classification. From the mathematical 
point of view, in an n-channel data set at least (n-i-1) samples should be provided for each 
class, otherwise the variance-covariance matrix for that class will become singular. In 
practice it is suggested that at least lOn to lOOn pixels be sampled for each class (Swain 
and Davis, 1978). 

Theoretically, the ML classification algorithm is known to be optimal in the sense of 
minimizing Bayesian error. However, in practice it has been shown that results produced 
by the classifier are not optimal and the classification results may show considerable 
variation depending upon the manner in which statistical classes are formed (Ince, 1987). 
The root cause for this lies in the underlying assumption of normality in the remotely- 
sensed data set. In many situations one may not even know how far off one may be from 
the true underlying distribution and therefore cannot estimate the consequences. 


2.2.3 Mathematical Formulation for Software Operation 

The probability P(x) that for a pixel vector x of p elements (a pattern defined in terms of p 
features) is a member of class\ is given by the multivariate normal density: 

I 
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P(x) = 27r-0-5p I zj -0.5 exp[-0.5 (y'Zf ly)] 


( 2 . 1 ) 


where 1.1 denotes the determinant of the specified matrix, £j is the sample variance- 
covariance matrix for class i, y = (x -jij) and |i,j is the multivariate mean of class i. The 
term (yXf ^y) is the Mahalanobis distance, which measures the distance of an observation 
from the class mean, correlated for the variance and covariance of class i. 

The function P{x) can be used to evaluate the probability that an unknown pattern x is a 
member of class i (i = l,2,3...k). The maximum value in this set can be chosen and x 
allocated to the corresponding class. However, the cost of carrying out these 
computations for any but the most trivial case high. Savings can be made by first of all 
noting that we are only interested in the rank order of the values of P{x). Since the 
algorithm to the base e of a function has the same rank order as the function, the 
evaluation of the exponential term might be avoided by evaluating 

ln(P(x)) = -0.5pln(2Tc) - 0.5 In ! Zj 1 - 0.5(y’Zfly) (2.2) 

The rank order will also be unaffected if this expression is multiplied by 2 and the constant 
term pln2n: dropped. The expression would look tidier if it was multiplied by -1 and the 
smallest value for all k classes chosen, rather than the largest. This would reduce the 
expression to 


-21n(P(x)) =lnlZil +y’Zfly (2.3) 

Further savings are made by computing the inverse and determinant of each Z in advance 
and are read from a table when required. The computations then reduce to the derivation 
of Mahalanobis distance, the addition of the logarithm of the determinant of the estimated 
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variance-covariance matrix for each of the k classes in turn, and the selection of the 
minimum value Irom among the results. Since we have multiplied the original expression 
by -1 we minimize -21n (P(x)) so as to achieve the same result as maximizing P(x). The 
computer time required increases exponentially with k, the number of classes, and with 
p, the number of bands(dimen.sionality) (Mather, 1987). 


2.3 Role of Training Data in Supervised Classification 

Supervi.sed classification methods are based upon the prior knowledge of the number and 
the statistical parameters of the spectral classes. The statistical properties of the classes are 
estimated from the training pixels making up a class and the statistical parameters needed 
for classification will depend on the method used for the supervised classification. For 
example the parallelepiped method requires estimates of the extreme values on each of the 
feature for each class, while the k-means or centroid method needs estimates of the 
multivariate means of the classes. The method used in the thesis, the maximum likelihood 
algorithm, requires estimates of the mean vector and variance- covariance matrix of each 
cia.ss. 

it is of crucial importance to ensure that the a priori knowledge of the number and 
statistical characteristics of the classes is reliable. The accuracy of a supervised 
classification analysis will depend upon two factors: (i) the representativeness of the 
estimates of the statistical spectral classes present in the image data and (ii) the degree of 
departure from the assumptions upon which the technique is based. 

The validity of statistical estimates depends upon two factors - the size and 
representativeness of the sample. Sample size is related to the number of variables 
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(spectra! bands in this case) whose statistical properties are to estimated, and the number 
of those statistical properties. For the multivariate property estimation the size should be 
atleast 30p pixels per class, where p is the number of features (spectral bands), and 
preferably more. The training samples are normally located by field work or from air 
photograph or map interpretation, and their positions on the image found by visual 
inspection. 


2.4 Conventional Training Area Definition Procedures 

The location of training areas in the image is normally established using windows, or 
portions of the full scene, in an enlarged format on an interactive color display device. The 
image analyst normally obtains training sample data by outlining training areas using a 
reference cursor. The cursor may be controlled by any of the several means (e.g. a tracker 
ball, joystick, digitizer, mouse, or keyboard stokes). The training areas are delineated on 
the image by drawing polygons on the image. The training area pixels are so located to 
avoid pixels along the edges between land cover types. The row and column coordinates 
of the vertices of these polygons are used as the basis for extracting (from the image file) 
the digital numbers of the pixel values located within each training area boundary. These 
pixel values then form the sample used to develop the statistical description of each 
training area. The conventional technique used for training area extraction has been shown 
in Figure 2. 1 . These training areas defined on the Bhopal and Singrauli images in band 3 
are shown in Plates 2.1 and 2.2 respectively. 

When delineating training set pixels, it is important to analyze several training sites 
throughout the scene. Training pixels for each class should be well distributed spatially to 
account for spatial variation in the class. 
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Figure 2.1: Supervised Approach of Classification using the Gaussian ML 
Classifier (modified after Dikshit, 1992) 














Plate 2.1 


Traditional training image superimposed on band 3 image, 
Bhopal Area. 
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Plate 2.2 


Traditional training area image superimposed on band 3 image, 
Singrauli Area. 
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2.5 Evaluation of the Training Area 


As part ot the training area refinement process the overall quality of the training data 
contained in each of the original candidate training areas is assessed and the spectral 
separability between the data set is studied. One has to check if all data sets are essentially 
normally distributed and spectrally pure. Training areas that inadvertently include more 
than one spectral class are identified and recompiled. Likewise, extraneous pixels may be 
deleted from some of the data sets. These might be the edge pixels along class boundaries 
or within field pixels representing classes. Training sets that might be merged (or deleted) 
are identified, and the need to obtain additional training sets for poorly represented 
.spectral class is addressed. 

One or more of the following types of analysis is typically involved in the training set 
refinement process. 

2.5.1 Divergence Analysis 

A measure of the statistical separation between classes can be computed for all pairs of 
cla,sses and can be presented in the from of a matrix. One statistical parameter commonly 
used for this purpose is divergence, a covariance-weighted distance between category 
means. In general, the larger the divergence, the greater the statistical separability and 
hence better accuracy in classification due to less confusion. Many mathematical 
expressions for divergence exist. One of the most widely used for calculating divergence is 
(Swain and Davis, 1978): 


Dij = 0.5 tr(Ei . Ej) - (Ej-l- Ef 1) + 0.5tr(|j.i - \ip^ - (Ef 1- Ej-l)(pi - pj) (2.4) 
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where D,., is the divergence between class i and j, and tr[A] is the trace of matrix A. 


The range ot D,, is 0 to infinity, higher values implying greater separation. Because 
divergence increases without bound as statistical separability between classes reaches 1 00 
percent, Swain et ai. (1971) defined a saturation transformed divergence which provides a 
measure more closely corresponding to per cent classification. The pairwise transformed 
divergence is defined as 


TDj.i = Kll-Exp(-Di.j/8)] (2.5) 

K is a constant which can be taken as 100 to interpret transformed divergence as a 
percentage. 


2.5.2 Classification of Training Data 

Another evaluation of good training data is provided by a contingency table (which is also 
called a confusion matrix). This table is prepared by classifying the training set pixels. The 
known category types of the pixels used for training set are listed versus the categories 
chosen by the classifier. From this information, classification errors of omission and 
commission can be studied. In an ideal case, all nondiagonal elements of the contingency 
table would be zero, indicating no misclassification. Commission errors are represented 
by nondiagonal elements of the table where pixels are classified into a category to which 
they do actually belong. Omission errors represent the reverse type of situation. If more 
than an acceptable percentage of the pixels in a class is misclassified, that category may 
warrant further inspection and retraining. 
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The accuracy troiu contingency table based on training pixels should not be considered 
as a measure of overall classification accuracy. The contingency table simply tells us how 
well the classitier can clas.sity the training areas and nothing more. Because the training 
areas are usually good, homogeneous examples of each cover type, they can be 
expected to be classified more accurately than less pure examples that may be found 
elsewhere in the scene. The overall accuracy can be evaluated only by considering test 
areas that are different from, and considerably more extensive than, the training areas. 

The test for accuracy is usually in the form of a confusion table or error matrix or 
contingency table. This is an M x M table where M represents the total number of classes. 
The rows in the matrix represent the assumed true classes. The entries in the contingency 
table represent the raw number of pixels encountered in each condition and may also be 
expressed as percentages. One of the most important characteristic of such matrices is 
their ability to summarize errors of omission and commission. In the confusion table the 
diagonal elements represent the observations which agree on reference and classified 
training area and non-diagonal entries represent cases where observations do not agree. 


2.6 Semi Automated Technique for Training Area Definition 

2.6.1 Introduction 

The traditional techniques for training area definition in supervised classification are 
manual techniques, i.e. the user selects an area on the image with the help of a mouse or 
any other similar device. The term ‘semi automated' refers to training area selection 
automatically by the computer, with the user defining some conditions and parameters for 
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the region selection to the computer (and thus the term ‘semi' gets introduced). The 
techniques u.sed here were developed so as to increase the degree of automation in 
training field extraction, thereby significantly reducing analyst time requirement, while 
maintaining acceptable levels of classification accuracy. The procedure is still 
fundamentally grounded with ‘per-point’ (as opposed with ‘per-field') classification 
framework, and therefore carries with it all problems inherent in such an approach (i.e., no 
spatial, textural, or contextual information is used in the classification). The intended 
purpose of the new technique, however, is to provide a tool whereby the utility of a per- 
pixel approach, limited as it may be for a second generation data applications, could be 
improved. It was also viewed as a potential complement to other non-traditional image 
analysis techniques and as a possible efficient conduit for integration of remotely sensed 
data and geographic information systems (GISs). 


2.6.2 The Motivation to Evolve Alternate Methods for Training Area 
Selection 

According to Swain and Davis (1978) the appropriate training sample size is between 
lOn and lOOn, where n is the number of image channels. It can be quite easy to find 
homogeneous areas for crops when the field size is large, but the same task can be very 
difficult for natural vegetation, which usually exhibits great spatial and spectral variability. 

The tremendous spatial and spectral complexity of second generation data can make it 
extremely difficult and tedious both to locate and delineate supervised training fields 
satisfying assumptions for the Guassian ML Classification. This is compounded by the 
need to ensure that all important - classes within the highly-variability data have been 
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adc(|uaicly characterized spectrally, or even sampled at all. Furthermore, the clustering 
algorithms and parameters ot many widely u,sed unsupervised techniques were designed 
.s{xrcitically with MSS data in mind, and thus are not universally applicable to data with 
fundamentally different characteristics. This factor is the major reason for the need to 
develop automatic procedures for extraction of training data. The extraction process 
should find those class-fomiing pixels, which are in majority inside a region, but have 
irregular (‘spongy’) spatial distribution. Semi-automated techniques may improve the 
efficiency and accuracy of spectral class identification. Region growing techniques have 
been develoj^ed which require the analyst to identify a .single seed pixel for each training 
.set (Buchheim, 1988). The algorithm then adds adjoining pixels to the training field in an 
option-controlled manner until one of .several potential termination criteria is surpassed. 
The size, .shape, spectral variability, and the local homogeneity can be used to control 
region growth. These techniques have been shown to improve training efficiency with no 
lo.ss in classification accuracy over a range of conditions (Buchheim and Lillesand 1989). 


2.6.3 An Alternative approach to Training Area Definition: The Seed Pixel 
Approach 

As an alternative to manually delineating training area polygons, the semi-automated 
technique used here is the seed pixel approach to training. In this case, the display cursor 
is placed within a prospective training area and a single seed pixel is chosen so that it is 
thought to be repre.sentative of the surrounding area. Then according to various 
statistically based criteria, pixels with similar spectral characteristics that are four 
connected neighbours to the seed pixel are highlighted on the display and become the 
training samples of the training area. 
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In the seed growing technique for training area selection applied here, a ‘seed’ pixel is 
selected from a toirly homogeneous area (located visually), on the image. The algorithm 
then scans the four nearest neighbouring pixels. If the conditions 

I Gray level ot seed pixel - Gray level of the pixel being scanned 1 < User defined threshold 

are satisfied, then that pixel becomes seed pixel, and it gets marked. Now, the four nearest 
neighbours ot that pixel become seeds, and the above condition is again checked. This 
way, the recursive growth of pixels continues till till the seeds have all the four nearest 
neighbours not .satisfying the thresholds. The order of evaluating the seeds is right, down, 
left and up, as .shown in Figure 2.2 

The .seed algorithm works in the multispectral mode, i.e. it checks for the above growth 
condition in all the bands specified by the user, before marking a pixel as a training area 
pixel. Each seed pixel .specified in the program may posses a unique threshold for its 
growth, such that, during training data extraction, the procedure can be sensitive to 
differences in within-class variation in spectral response that are often observed among 
cover types (e.g. water versus urban) in remotely sensed data. The training area selected 
by seed pixel algorithm on the two images is shown in Plate 2.3 and 2.4 respectively. 
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Figure 2.2 Order of growth of seed pixels in the algorithm used in the study. The 
centre pixel represents seed pixel defined by the user. The four nearest 
neighbours are marked by The order of growth is indicated by 
numbers 1,2,3 and 4. 
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Plate 2.3 


Training area image generated by seed pixel approach, superimposed 
on Band 3 Image, Bhopal Area. 
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Plate 2.4 


Training area image generated by seed pixel approach, superimposed 
on band 3 image, Singrauli Area. 


24 



2.7 Training Data Refinement Techniques 


2.7.1 Introduction 

The fine line to be walked in the development of the training data sets is that of having 
sutficient sample size to ensure accurate determination of the statistical data parameters 
used by the classitier and to represent the total spectral variability in the scene, without 
going past a point of diminishing returns. In short, one does not want to omit any 
important spectral classes occurring in a scene, but also does not want to include 
redundant spectral classes in the classification process from a computational standpoint. 
During the proce.ss of training set refinement the analyst tries to identify such gaps and 
redundancies. 

As part of the training set refinement process the overall quality of the data contained in 
each of the original candidate training areas is assessed and the spectral separability 
between the data set is studied. The analyst carefully checks if all data sets are essentially 
normally distributed and spectrally pure. Training areas that inadvertently include more 
than one spectral class are identified and recompiled. Likewise, extraneous pixels may be 
deleted from some of the data sets. These might be the edge pixels along class boundaries 
or within-field pixels containing classes or some other class pixels which might be present 
there. Training sets that might be merged (or deleted) are identified, and the need to obtain 
additional training sets for poorly represented spectral classes is addressed. The 
techniques used for the analysis of quality of the training area have been described above. 

In general, the training set refinement process cannot be rushed with the ‘maximum 
efficiency' attitude appropriate in the classification stage. It is normally an iterative 
procedure in which the analyst revises the statistical descriptions of the class types until 
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the classes are sufficiently separable. That is, the original set of candidate training area 
statistics is revised through merging deleting addition to form the final set of statistics 
used in the classification. 

Training set refinement for the inexperienced data analyst may be a difficult task. 
Typically, an analyst has little difficulty in developing the statistics for the distinct 
nonoverlapping spectral classes present in a scene. If there are problems, they typically 
stem from spectral classes on the borders between the information classes - transition or 
overlapping classes. In such cases, the impact of alternative deletion and pooling of 
training clas.scs can be tested by trial-and-error. In this process, the sample size, spectral 
variances, normality, and identity of the training sets should be rechecked. After studying 
the actual classification results, the image analyst might be faced with aggregation of 
certain detailed classes into more general ones. 

One final note may be made here is that training set refinement is usually the key to 
improving the accuracy of a classification. However, if certain cover types occurring in the 
image have inherently similar patterns, no amount of retraining and refinement will make 
them spectrally separable! Alternative methods, perhaps including visual interpretation 
or fields checking, must be used to discriminate these cover types. 


2.7.2 Necessity of Automatic Methods of Training Area Refinement 

1. No enhancement procedure alone, can highlight the variability in the 
complete dynamic range of gray levels in the digital data. Some alien pixels 
are always bound to get included because of the limitation of the human 
eye to discriminate subtle color variations. 
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The training area set should be representative of the whole area to be 
classified and the derived parameters should fit to the applied classification 
model. The widely used maximum-likelihood (ML) classification requires 
the computation of mean value and covariance matrix for all categories. 
The sample should follow a Gaussian distribution for a reliable estimation 
of above parameters. Obtaining a Gaussian distribution of training data is 
facilitated by using homogeneous training areas. Homogeneity is usually 
judged by the user (interpreter) viewing the data in the foim of a color 
composite on the screen of an image processing device. The visual check 
however can often be misleading because histogram equalization, which is 
a widely used enhancement method gives similar brightness for large values 
of pixel values lying at the margins of the actual dynamic range. 

If a single band imagery were available, the study of a histogram of the 
frequency counts associated with each pixel value in the training data could 
help to reveal observations which were far from the mean (and hence the 
outliers). Alternatively, the cumulative frequency histograms might be 
plotted on normal probability paper, and outliers detected visually. 
Simple procedures such as these are not possible with high dimensional 
data. 

Histogram can be used to display the distribution of the training area in 
each channel. When one of the distributions is multi-modal or long-tailed 
the user can modify the corresponding training area. However, this 
would increase the time-consuming process of training further; therefore 
an automatic cleaning of training data is recommend. 



2.7.3 Automated Refinement Techniques 


2.7.3. 1 Overview 

The inclusion of anomalous pixels in the training sites is a formidable problem in the 
supervised classification of images. Methods generally aim at overcoming these problems 
cither by reconditioning the statistical parameters or by systematically dropping pixels 
from the training site data. The method proposed by Mather (1987) falls in the first 
category which aims at a robust estimation of statistical parameters by giving weights to 
pixel values in the training class depending on its Mahalanobis distance. In the second 
category a method proposed by Buttner et al. (1989) aims at iteratively removing pixels 
from the training data if their distance to the mean is greater than a certain predefined 
times standard deviation in any of the image bands. 

Another method called visual outlier removal operates by eliminating pixels from the 
training site that lie outside a feature space mask. However, this method takes into 
account only two image bands at a time. The method proposed by Arai (1992) uses single 
band data to decide whether a particular pixel should be retained in that class or dropped. 
Gill and Gill ( 1993), presented a training site cleaning procedure which takes into account 
spectral overlap in all image bands and for all user specified classes simultaneously. 
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2.73.2 Mather's Method of Refinement 


Importance of the method 

• Use of this procedure is not limited to classification. Any statistical algorithm requiring 
estimates ot mean and variance-covariance for a supposedly multivariate-normally 
distributed population would benefit from preprocessing using this method. 

• The robust estimators are automatic, and the computing requirements are low. 

• No visual interpretation of scatter plots is necessary. 

• The procedure produces essentially the same estimates of ji and 2 and where ‘pure' 
training data are supplied, and less biased estimates where the training data are 
contaminated. 


Theoretical Foundation 


The probability that an observed pixel vector Xo belongs to class k given the sample 
estimates of )i and X for all possible classes is derived from the classical expression for 
the multivariate distribution: 


p(xlWk) = 


271 


pl'^\ Xi 


Yi2 exp 1 / 2(Xo - pA:)' ^ {Xo - p*) 


( 2 . 6 ) 
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where and 'Zk the estimated mean vector and variance-covariance matrix for class 
k, p is the number of spectral bands, and is the inverse ofZk • The expression 

p(X()lWi;) are calculated for all m classes; pixel vector xq is allocated to that class for which 
p(XolWk) is a maximum. 

The parameters of the above are p^and Zk ■ The former fixes the centre (location) of the 
probability distribution of associated with each class k, while the latter defines the shape of 
distribution. If either estimate is inaccurate then the reliability of the calculated 
probabilities pfxolwi^) will be affected. One major cause of inaccuracy in estimating p and 
E is the inclusion of pixel vectors in the training data for class k which, in reality, do not 
belong to class k; they may belong to another class altogether or they may be hybrid or 
mixed pixels. 

Mather's technique is based on a paper by Campbell (1980), which has considered ways in 
which atypical values in a sample could be detected and proposes estimators of mean and 
variance-covariance matrix which are robust (that is, they are not unduly influenced by 
atypical values). These estimators give full weight to observations that are assumed to 
come from the main body of the data but reduce the weight given to observations 
identified as aberrant. A measure called Mahalanobis distance is used to identify deviant 
members of the sample. Its square is defined by 

dl=^{xi-\iiyz ■’(x,-pO (2.7) 

th 

where i is the index counting the elements of the sample, Xi is the i sample value (pixel 
vector). Pi is the mean vector and Z is the sample variance-covariance matrix of a given 
sample (class). The transpose of vector x is denoted by x'. Robust estimates of mean and 
variance-covariance matrix are computed using weights which are functions of 
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Mahulanobis distance. The effect is to downgrade those pixel values with high 
Mahalanobis distances, which represent pixels that are relatively far from (dissimilar to) 
the mean of training class, taking into account the shape of probability distribution of 
training class members. For uncontaminated data the robust estimates are close to those 
obtained from the usual estimators. The procedure for obtaining the weights is described 
and illustrated by Campbell (1980); 


^vva'a 

(k=l,2 ,p) 


( 2 . 8 ) 


ik' 


■ ^wlixkf 

Z=1 
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\ij) I ( S 
i = 1 




1 ) 


(2.9) 


where 

n = number of pixels in the training sample 

p = number of features 

w ,= weight per pixel 

Xk, = value for pixel on feature k 

Xk = mean of k th feature for this case 

Sjk = th element of variance-covariance matrix for this class 

The weights are found from: 


Wi = F(di)/di 


( 2 . 10 ) 


given 
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di ifd, <do 

F(d,)= (2.11) 

d()exp[-0.5(di-do)“/ ] otherwise 

and 

d, = Mahalanobis distance of pixel i for this class 
d() = p + bi/2 
b, = 2 
b2= 1.25 


The weights w, are initially computed from the Mahalalnobis distances which are 
themselves computed from pj and Ej derived from the above formulae with unit weights. 
The Mahalanobis distance and the unit weights are recalculated iteratively until successive 
weight vectors converge to within acceptable limits. On the basis of experiments, Mather 
(1987) defined the convergence as being reached when the maximum absolute change in 
any weight Wj from one iteration to the next was less than 0.01. It is then found that any 
aberrant pixel vectors is given very low weights and will therefore contribute only 
negligibly to the final (robust) estimates of |i and E which are required in the maximum 
likelihood classification scheme. 
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2.73.2 Buttner's Method of Refinement 


Important Features 

It actually cleans the data, i.e. it removes the non-representative pixels from the training 
data. It checks for the pixel removal condition in all bands, i.e. if a pixel is representative 
in one band but an outlier in any other band it is removed from the training data. The 
algorithm is simple and fast. The cleaning can be achieved in few minutes for digital 
imagery in three bands. 

Background 

It is a method to improve the effectiveness of the supervised learning in an interactive 
environment. An iterative procedure for cleaning training data is introduced to provide 
more appropriate class statistics (in terms of normality criterion) for classification. The 
anomalous pixels in the class are removed in a simple automatic way. 

Pixels are removed iteratively from the training data if their distance to the actual mean 
value is greater than a predefined limit. Considering the case of ML Classification this 
corresponds to a low probability of belonging to the class defined by |i and E. All pixels 
are taken into account in each iteration step. 

In the actual implementation the pixel x(xi, X 2 ,..,.Xi,...,Xn) is omitted if one of the following 
inequalities is fulfilled 

Ixi-Mil >kOi i=l,2, ....n (2.12) 
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where M, is the i'*’ element of the estimated mean vector, Oj is the ith element of the 
estimated standard deviation, x, is the ith element of the pixel vector, n is the number of 
channels and k is a user-specified parameter for the limit. The iteration is stopped if the 
maximum change in standard deviations is less than a limit 

(maxl(Oi)'-(a.y'‘l)<0.1 (2.13) 

where j is the iteration number. A maximum of ten iterations are allowed. By removing the 
outlying pixels, the distribution in each channel will approximate better to Gaussian, 
which in turn results in a better parameter estimation for the multi-dimensional normal 
distribution. The pixels removed by this method when refinement is applied on a 
conventional traininig area (selected as a box) has been shown in Plate 2.5. 

The limitation of this method is that it cleans a training site without taking into 
consideration the spectral overlap with other classes. 
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Plate 2.5 


The pixels removed by Buttner’s technique when applied on a 
conventional training area. 
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Chapter 3 


RESULTS AND DISCUSSION 


3.1 Introduction 

In chapter 2, the importance and methodology of alternate training area extraction 
procedure were discussed. The results of these methods have been presented in this 
chapter. The experiments have been performed on imagery of two sites, one of Singrauli 
mine area and the other of Bhopal city area. The classification of these sites using the 
traditional and improved methods have been discussed in this chapter. The classes used in 
classification have been listed in Table 3.1. 


3.2 Experimental Methodology 

The training area extraction and analysis was done under the following steps: 

• The training areas for classification of imagery was selected by 

conventional manual technique of drawing boxes on the image. The ML 
classification was carried out and the individual class accuracies were 
established. 
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• In the second step, the training areas for classification of imagery were 
selected by the seed pixel algorithm, with the initial seeds in those areas 
where the traditional training areas had been selected. In the seed pixel 
algorithm used here, the user provides a threshold gray level to be included 
in the region, based on the mean and standard deviation of the pixels in a 3, ? 
X 3 window. The ML classification was applied to this training area also. 

f 

• The training areas selected by the above two techniques were subjected to 
retinement techniques by two methods: the Buttner's approach of removing 
aberrant pixels from the class, at different standard deviations factors 
(k=l,2,..) as the threshold limit; and the Mather's method (Mather, 1987) 
of calculating robust statistics for classification. These two methods have 
been discussed in the section 2.8.2 and 2.8.3 respectively in the second 
chapter. Classification was performed on the original training data by the 
Mather's method and also on the refined data obtained by Buttner's 
approach of removing the aberrant pixels from the original data. The 
accuracy of classification of training data and test data was studied in each 
case. 

An overview of the methodology has been shown below in the Figure 3.1. 
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Imngc Clas'iifica'ion 



Figure 3.1 Flowchart showing the overall methodology followed in the study, 





















3.3 RESULTS 


3.3. 1 Experiments with Bhopal City Imagery 


The LISS II image of Bhopal city was used as the first test image. The semi-urban 
environment of Bhopal city consists of five prominent classes. Water, the main class in the 
image is mainly represented by the two big lakes in the city. The lakes are surrounded by 
marshy land. The residential area of the city is flanked by forests and unused land marked 
by sparse vegetation and scrub. 

The classification results can be analyzed by considering the following factors: 

a. Number of Pixels 

The number of pixels being selected as a training area can be controlled by the analyst in 
the traditional techniques, but in the seed pixel approach, the number of pixels getting 
marked as a training area is controlled by the algorithm being used for seed growth. The 
number of training area pixels selected by traditional techniques is 611 in the traditional 
case, while 4534 in the seed pixel approach. 


b. Mean and Standard Deviation 

The mean and standard deviation of the classes after each refinement step have been given 
in Table 3.2. It is observed that standard deviation in all the image bands for all the 
classes reduces after both the methods of refinement. This is associated with a shift in 
class means, which is likely to improve inter-class separability. 
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c. Class Covariance 


The class covariance tor each class is presented in Table 3.4. It is observed that the 
covariance values trom the traditional techniques are inflated by contamination. Therefore, 
the multivariate-normal probabilities calculated using initial estimates of E would be in 
error. Con.sequently the performance of the ML classifier will be reduced. It was observed 
that the estimates of X after the Mather and Buttner refinement is low, indicating the 
lesser spread of the class, and less aberrant pixels in it. 


d. Divergence Value 

Average divergence value increases after refinement method proposed by Buttner, 
indicating the greater separation between classes. The average, minimum, and maximum 
divergence values of traditional training area were 559, 35 and 1960 respectively. After 
refinement by the Buttner's method at k=2, the average divergence value increased to 630, 
with minimum and maximum values became 41 and 2101; This shows an increase in the 
separability after refinement between classes. The minimum transformed divergence 
increased to 99 from 98, while the maximum remained 100 before and after refinement. 
The average transformed divergence values did not show change, indicating that a 
sufficient separability had been achieved for classification before refinement (Tables 3.6 
and 3.7) . 

e. Accuracy of Classification 

The following observations were made: 
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1 . Cldssitication accuracies for unrefined training area using seed pixel approach is higher 
than that of the traditional technique. 

2. The Buttner s method refinement at k=2 proved to be the best for ML classification in 
this case. While k=l, removes the inherent heterogeneity of a class, k=3 value tends to 
include aberrant pixels which diminish the accuracy of classification (Table 3.13). 

The individual class accuracies have been analyzed below: 

Water This class is most accurately classified by all the methods applied in the study. 
The te.st and training area classification accuracy is more than 99% in nearly all the cases. 

Forest The traditional training area technique gives the test accuracy of 80.37%. This 
accuracy falls sharply by using the Buttner's technique at k=l, when many pixels have been 
dropped after the refinement process. At k=2, when most of the pixels in the class have 
been retained, the accuracy improves, but remains low compared to the traditional 
technique. It may be that in a heterogeneous class like forest, the statistically aberrant 
pixels are an important member of the class. These pixels should also be included in 
defining/capturing the overall statistical variability of a heterogeneous class. The Mather’s 
refinement procedure gives the same accuracy as that of the traditional technique. 

The seed pixel algorithm sharply improves the test area classification accuracy of the 
classifier (97.65%). It shows that seed algorithm can be very useful in heterogeneous 
environment, where it can select the classes in a much better way than the traditional 
methods. 
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Marsh It is the most poorly classified class by all the strategies applied here. The 
traditional tiaining area selection techniques gives the test area classification accuracy of 
55.12^f . The Buttner refinement technique at k=l was able to improve it to 61.33%, 
which was the highest test accuracy attained by any of the methods used here for this 
class. This bad classification may be due to the fact that marsh is a transition class, 
representing a land - water boundary. 

Urban Area The Buttner's refinement technique at k=2, was able to improve the test 
classification accuracy by traditional methods (89%) to 91.5%. 

Scrub The Buttner's refinement at k=2, improved the classification accuracy by 
traditional technique (89%) to 91.5%. 

3.3.2 Experiments with Imagery of Singrauli Area 

The LISS II image of Singrauli mine represents a semi-natural environment. The image 
consists of rocky terrain and forests. There are large mine dump areas on the image. In 
the south-eastern part of the image, the Govind Ballabh Pant reservoir is present. There 
are many water filled areas on the image too. Since the banks of the reservoir is highly 
silted, it has been considered as a different class from clear water bodies. 

a. Number of Pixels 

The number of pixels selected for training by seed algorithm is quite high (7015) 
compared to the training area pixels selected by conventional techniques (1456). The main 
reason is the selection of reservoir water class training area by the seed algorithm. Since 
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the standard deviation of the reservoir water class is quite low, the seed algorithm selects 
nearly the whole reservoir water area as a training site. 

b. Mean and Standard Deviation 

As expected, the mean and standard deviation decrease with each refinement step by the 
Buttner's refinement technique. A step by step change in standard deviation at different k 
values is given in Table 3.3. 

c. Covariance 

The covariance values before and after the refinement by the Buttner's and the Mather's 
approach have been given in Table 3.5. As expected, the refined covariance values are 
lower than the original ones. 

d. Divergence 

It was found that the seed algorithm improved the inter-class separability for each 
individual class (Tables 3.10 and 3.11), although the average divergence remained lower 
than that obtained by traditional method. The average divergence values increased after 
refinement by Buttner's technique, but the transformed divergence remained constant at 99 
due to its saturating behaviour. 

e. Accuracy of Classification 

The following observations were made: 


43 



1 . T he Miithcr s tcchnicjuc of refinernent does not show sny significant chnngc in 
classification accuracy when compared to the traditional classifier. 

2. Application of Buttner refinement technique on the seed pixel training area actually 
decreased the classification accuracy rather than increasing it at some k values. 
Mather's technique showed marginal improvement in accuracy when applied on the 
seed training data. 

The individual class accuracies have been analyzed below: 


Reservoir Water This class is having 100% accuracy of classification for training area as 
well as test area by all the classification strategies applied here. 

Forest Training Area classification accuracy by traditional technique is 94.55%. With the 
seed pixel algorithm approach it increased to 100%. Test area accuracy is maximum 
(86.21) by the Buttner refinement of traditional data at k=2. The seed pixel algorithm 
gives a comparatively low classification accuracy (70.88%). 

Mine Dumps The training area accuracy is 100% by all the methods applied. The 
traditional technique gave the test area classification accuracy as 100% before and after 
the Buttner’ s refinement technique whereas the seed pixel algorithm gave lower 
classification accuracy of 97.74% for the same case. 

Rocky Terrain The training area classification accuracy of 100% was obtained by all 
methods. But the maximum test area accuracy achieved by traditional methods is 98.62% , 
which improves marginally to 98.90% by Mather's method. The maximum accuracy 
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achieved in this ease is by seed pixel algorithm, which gives 100% test area accuracy for 
this class. 

Water Bodies Training area accuracies obtained for this class is 100% by all the 
methods, except when the refinement by Buttner's technique is applied at k=l. Maximum 
test area accuracy is achieved by seed algorithm (96.94%). While the traditional technique 
gave cla.ssification accuracy of 84.62%, the Mather's technique marginally improved it to 
84.97%. 

3.4 DISCUSSION 

For better training area extraction, alternate training area selection procedures and 
refinement techniques were used in the thesis. Although, the overall classification accuracy 
did not show sharp improvement by any of the methods used, but the individual class 
accuracies, showed marked changes with refinement. 


3.4.1 Refinement using Robust Estimates of Training Statistics 

In this refinement technique proposed by Mather (1987), the robust estimators axe 
automatic, and computing requirements are low (the ML classification took nearly 4 
minutes for classification for 5 classes, while the refinement and classification by Mather's 
technique took 5 minutes for the same case, on HP 9000/735 systems). No visual 
interpretation of scatter plots is necessary. The procedure produces essentially the same 
estimates of Ji and E where pure training data are supplied, and robust estimates where 
the training data are contaminated. The efficiency of the proposed procedure is 


45 



demonstrated by the fact that the classification accuracy by this approach matches with 
that of the ML classifier, and marginally improves the ML classification results when the 
classifier accuracy is already high. This method takes into account the variance- 
covariance in all image bands. 

In this technique the weights are a function of Dj, the Mahalanobis distance, which in 
turn is a function of Dq, i.e. Dj = aDo (equation 2. 1 1 ). Mather suggested the value of a 
to be 0.75. He derived this value by experimenting with many synthetic images. This 
factor was found to be .suitable for natural images used in this investigation also. It was 
observed that the accuracy of classification falls sharply with the change of a. The change 
of D() factor from 0.75 to 0.70 reduced the accuracy of training area classification from 
98% to 66% for the Singrauli mine image. 

This method took a maximum of 6 iterations for upgrading the training area statistics in 
experiments. This less number may be due to the fact that the original data were already 
having high separability. 


3.4.2 Refinement by Aberrant Pixel Removal 


This simple method of improving the effectiveness of supervised training in an interactive 
environment, proposed by Buttner et. al. (1989) gave significant changes in standard 
deviation, divergence and accuracy of classes. The following observations can be made: 

1 . Less than 1 0 iterations were enough to stop the refinement process in each class. 

2. The lower k value required a larger number of iterations. 
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3. Changes in mean and standard deviations are more in infrared channels than in visible 


ones. 


4. The dittcrences are very small in the mean and standard deviation values for water due 
to small within class variance, while they are pronounced for vegetation categories 
(larger within-class variance). Moderate changes in class stability are obtained for 
rix'ky terrain class. 

5. In the vegetation classes, the classification accuracy drops at k=l, and improves 
sharply at k=2. Because of large standard deviation values only a few pixels are 
considered to be outlying at k=2. 

6. The benefit of iterative training is seen from the improvement in class separability. The 
improvement is mainly due to the change of the standard deviation, since as shown in 
Tables 3.6, 3.7, 3.8, 3.9, 3.10, 3.1 1, 3.12, the mean values are rather insensitive to the 
clu).sen values of the parameter k. Therefore, classification methods using second 
order statistic.s, such as the ML algorithm, can benefit from the iterative training. 


3.43 Seed Pixel Algorithm 


By virtue of its design and implementation, the seed pixel procedure of training area 
definition has the potential to solve several of the problems encountered with traditional 
forms of supervised classification with second generation satellite imagery: 
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Because only one pixel must be located in the image, the seed pixel 
algorithm reduces the probability of wrongly locating the ground classes on 
the image and may produce dramatic reductions in the amount of analyst 
time required for training field delineation. Thus this algorithm, may 
eliminate much of the complexity involved in training on spectrally and 
spatially complex imagery. 

In contrast to the traditional supervised procedures which mark pixels 
using rectangular windows of image data, pixel extraction using seed 
algorithm strategy is not biased toward the exclusion of objects of a 
particular shape or orientation: fields may grow out along linear features as 
easily as within rectangular features; the importance of adequately 
characterizing such features spectrally has increased with the improved 
spatial resolution of second generation data. 

In the seed pixel algorithm, each seed pixel specified in the program may 
possess a unique threshold for its growth, such that, during training data 
extraction, the procedure can be sensitive to differences in within-class 
variation in spectral response that are often observed among cover types 
(e.g. water versus urban) in remotely sensed data. 

The seed pixel algorithm may be used very effectively to delineate the large 
numbers of training fields which may be required to adequately characterize 
the spectral variability of second generation satellite data; manual marking 
of such data can be exceedingly tedious. 



The results achieved tor overall classification accuracy by the seed pixel algorithm used in 
this work show marked improvement in training area accuracy (100% accuracy attained in 
almost all cases). Although the test area classification accuracy is quite high (more than 
90% ), it is nuuginallv better in its performance when compared to the traditional technique 
results. When individual class accuracies are analyzed, the seed pixel algorithm gives 
better results in nearly all cases, but the marked improvement in its performance is only 
.shown in classifying natural heterogeneous classes like forests and rocky terrain. The 
classification accuracy with seed pixel algorithm in the test areas for these classes 
increases to 97.65%' and 100% respectively as compared to the traditional technique 
results of 80..’^7%’ and 98.62% re.spectively. 
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Table 3.1 


Classes used in classifying the images of the two study sites. 


Bhopal Image 

Class No. 

1 . 

2 . 

4. 

5 . 


Singrauli Image 

Class No. 

1 . 

2 . 

3. 

4. 

5. 


Information Class 

water 

forest 

marsh 

urban (built-up area) 
scrub 


Information Class 

reservoir water 
forest 

mine dumps 
rtKky terrain 
water bodies 



Tabk‘ 3.2 Mean and standard deviations obtained with different k parameter 
values for the refinement applied by the Buttner’s technique on the 
traditional training area of Bhopal Image 


Class 

k 

Band 3 

Band 4 

Band 1 

Iteration 

# 




0 

\i 

0 

It 

a 


Water 

00 

16.0 

0.0 

11.45 

0.00 

34.64 

0.03 



2 

16.0 

0.0 

11.45 

0.00 

34.64 

0.03 

1 


1 

16.0 

0.0 

11.45 

0.0 

34.64 

0.03 

1 

Forest 

00 

23.65 

1.832 

27.70 

2.256 

37.42 

0.96 



2 

23.42 

1.40 

27.96 

0.0 

32.33 

0.81 

1 


1 

24.0 

0.0 

28.0 

0.0 

37.0 

0.0 

3 

Marsh 

0© 

1H.23 

0.639 

22.839 

1.713 

34.167 

0.628 



2 

18.23 

0.0 

22.839 

1.713 

34.167 

0.628 

1 


j 

23.06 

0.807 ^ 

34.0 

0.0 

18.0 

0.0 

2 

Urban 

00 

ji.29r 

1.167 

29.261 

1.419 

42.88 

1.19 



2 

”3i’T8 " 

1.003 

29 M 

1.305 

42.85 

1.02 

1 


1 

31.0 

0.0 

29.0 

0.0 

43.0 

0.0 

2 

Scrub 

00 

38.673 

1.660 

41.465 

1.158 

42.54 

1.05 



2 

38.85 

1.49 

41.65 

0.976 

42.5 

0.97 

1 


1 

39.09 

0.792 

41.56 

0.496 

42.62 

0.485 

3 


^ I U ^ t . 

i I. T,, 


M0* A* m 
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Table 3.3 Mean and standard deviations obtained with different k parameter 
values for the rehnement applied by the Buttner’s technique on the 
traditional training area of Singrauli Image 


Class 

k 

Band 1 

Banda 

Band 4 

Iteration 

Number 




0 

|t 

0 


0 


RW* 

oo 

S6.74 

0.605 



ItgW' 




2.5 

86.74 

0.605 

79.80 

0.529 

IcIM 

0.593 

1 


1 

87.(X) 

0.000 



35.00 

wmm 

1 

Forest 

©O 

64.13 

2.600 

46.40 

3.41 

44.123 

imH 



2.5 

64. 13 

2.600 





1 

mill 

1 

6.^.(K) 

0.()(K) 

46.00 

0.00 

43.4 

ism 

4 

Mine 

oo 

62.37 

1.755 

52.575 

2.82 

58.9 

imi 


mmi 

'TJ 

62.37 

1.755 



59.9 

4.34 

1 


I 

63.63 

0.48 1 

53.00 

0.00 

59.49 


3 

Rock 

oo 

105.61 

10.899 

109.79 

11.27 

92.37 

13.22 





10.899 

111.59 

8.35 

92.373 

13.225 

1 


1 

103.00 

0.000 



ifcfeMU 

0.00 

6 

Water 

oo 




5.04 





2.5 


imiBi 

mg 



3.292 

1 


1 

75.000 

0.000 



76.00 

0.00 

5 


*RW : Reservoir Water 

























































Table 3.4 


The change in covariance values with each iteration for each class in 
the Mather's refinement technique applied on the Bhopal Image. The 
decrease in the covariance values with increasing iteration is observed. 


Class No. 

Iteration No. 

Covariance Matrix 

1 

" 2 

! 

1.526 0.180 0.987 

0.180 0.311 0.138 

0.987 0.138 1.062 

2 

1.480 0.173 0.946 

0.173 0.311 0.133 

0.946 0.133 1.028 

1 

4.729 -12.698 1.685 
-12.698 52.403 -5.210 
1.685 -5.210 0.999 

2 

4.718 -12.812 1.681 
-12.812 52.182 -5.280 
1.681 -5.280 0.996 

3 

4.707-12.823 1.678 
-12.823 52.170 -5.288 
1.678 -5.288 0.995 

3 

1 

1.067 1.992 0.369 

1.992 9.815 1.123 

0.369 1.123 0.513 

2 

1.061 1.962 0.344 

1.962 9.733 1.039 

0.344 1.039 0.459 

3 

1.060 1.956 0.340 

1.956 9.716 1.022 

0.340 1.022 0.448 

4 

1 

3.047 -3.071 2.553 
-3.071 34.652 -5.637 
2.553 -5.637 2.976 

2 

2.982 -2.932 2.520 
-2.932 34.474 -5.573 
2.520 -5.573 2.963 

3 

2.966 -2.897 2.512 
-2.897 34.429-5.558 

2.512 -5.558 2.960 

5 

1 

11.043 7.000 -2.473 

7.000 6.237 -1.236 
-2.473-1.236 1.512 




















Table 3.5 The change in covariance values with each iteration for each class in 
the Mather's refinement technique applied on the Singrauli Image. 


(lass No. ! Iteration No. 


Covariance Matrix 


0.280 

0.076 

0.081 

0.076 

0.352 

0.156 

0.081 

0.156 

0.367 

0.279 

0.080 

0.083 

0.080 

0.343 

0.150 

0.083 

0.150 

0.364 

0.279 

0.080 

0.083 

0.080 

0.342 

0.150 

0.083 

0.150 

0.364 

11.758 

14.638 

6.080 

14.638 

46.419 

- 0.215 

6.080 

- 0.215 

6.863 


11.643 
14.572 • 
5.937 


11.611 

14.556 

5.900 


7.970 
6.438 ; 

3.971 


7.873 

6.681 

3.934 


7.860 

6.738 

3.927 


128.129 

89.674 

91.817 


126.103 

88.254 

90.627 


125.970 

88.111 

90.506 

125.913 

87.934 

90.344 

125.885 

87.822 

90.241 

25.518 

14.235 

11.281 

25.366 

14.042 


14.572 

46.364 

- 0.382 


14.556 

46.359 

- 0.417 


6.438 

18.916 

2.671 


6.681 

18.585 

2.775 


6.738 

18.480 

2.806 


89.674 

176.389 


5.937 

- 0.382 

6.711 


5.900 

- 0.417 

6.673 


3.971 

2.671 

3.088 


3.934 

2.775 

3.077 


3.927 

2.806 

3.074 


91.817 

7.308 


7.308 119.812 
88.254 90.627 

174.554 4.129 

4.129 118.227 


88.111 90.506 


174.075 

2.931 

87.934 

173.709 


2.931 

117.820 

90.344 

2.135 


2.135 117.478 
87.822 90.241 


173.490 
1.676 
14.235 
13.586 
7.662 
14.042 
13.337 
7.614 


I . 676 
1 17.272 

11.281 

7.662 

9.124 

II . 25 
7 . 61 . 















1 al)i€ 3.10 I raining area statistics and div6rgence analysis of the traditional 
training area for the Singrauli Image 

Image Bands Tsed are 13 , 4 . 

!V!eaii Valaes 


Class Nil ot Pixels I 2 3 


I 

■> 

,1 

4 

5 


4()(t K6.74 7‘}.8(! .^4.77 

\h2 W.14 46,41 44.12 

4(W 62,38 52.57 58.90 

118 105.61 KW.80 92.37 

.167 74,50 80.97 75.62 


CIas.s Covariance 


1 

3? 

m 

.16 


.UK 

28 

08 


IP 

m 

35 

s 

hMh 

6.1)8 

- 22 


6.0H 

1 1 .76 

14,64 


' 22 

14.64 

46.42 

3 

im 

3.97 

2.67 


33)7 

7.97 

6,44 


2.67 

6,44 

IH.92 

4 

! 19.81 

9I.K2 

7,31 


91.82 

12K.13 

89.67 


7.31 

89.67 

176,39 

5 

9.12 

11. 2H 

7.66 


I I.2K 

25.52 

14.24 


7.66 

14.24 

1 3.59 


Divergence Matrix 


('I.AS.SliS 

n.A.S.SiiS I 2 .3 4 5 


1 0 .3336 4457 54.57 4131 

2 33.36 0 20 203 134 

3 4457 20 0 317 70 

4 .5457 203 317 0 64 

5 4131 134 70 64 0 

The Average Divergence Value = 1819 


Transonned Divergence Matrx 
CLASSES 

CLASSES 12345 


1 0 100 100 100 100 

2 100 0 92 100 99 

3 100 92 0 100 99 

4 100 100 100 0 99 

5 100 99 99 99 0 


The Average Transformed Divergence V alue = 99 



Fabli? 1 I raining area statistics and Divergence Analysis of the Singrauli 

Image at k=:I. 


Image Baucis Vmd are 13,4. 


Mean Valats 


Cla\s No of Pixels I 2 3 


1 

1 28 

m 

(»2 

*"9 3K 

34.70 

s 

143 

(4. 

30 

46.46 

43.68 

3 

352 

62, 

26 

52.51 

5H.77 

4 

111 

105 

,77 

1(W..V) 91.y5 

5 

333 

74 

51 

8a.S7 

75.62 


Class C'lnariaace 


I 

.46 

.18 

.25 


,!H 

.61 

.19 


.25 

.19 

.43 

1 

721 

6 82 

I 15 


6.H2 

1 I3i 

16.80 


1 15 

16.80 

47,95 

3 

3.31 

4.56 

3.16 


4.56 

9.23 

7.42 


3.16 

7.42 

21.07 

4 

126.89 

98.23 

8.96 


98.23 

135.59 

93.91 


8.96 

93.91 

184.43 

5 

9.61 

12.46 

H.26 


12.46 

2HJM 

1 5 69 


H.26 

15 69 

14.45 


DIvergeare Matrix 
(1.ASKHS 

(1.ASSES 12 3 4 5 


! 0 2374 4044 4165 4291 

2 2374 0 2i 183 125 

3 4044 21 0 3(K) 61 

4 4165 183 300 0 64 

5 4291 125 6! 64 0 

The Average Divergence Value 1563 


Transtirmed Divergence Matrx 
CLASSES 

CLASSES 1 2 3 4 5 


1 0 HK) 1(K) 100 100 

2 100 0 92 100 99 

3 iOO 92 0 100 99 

4 100 100 100 0 99 

5 100 99 99 99 0 


The Average Transformed Divergence Value = 99 



Tabk 3. 1 2 Ket‘d pixel training area statistics and divergence analysis of the for 
the Singrauli Image 

Imiige Bunds fscd ar« 13.4. 

Mean Values 


(las-. Nu i>l Pixels 1 : .1 


1 5044 86,27 Kfl.KO 57.70 

2 212 6.V28 53,(W 60.8.5 

5 285 10.5.75 i 15.78 W.94 

4 1226 7.5.87 70.20 77.64 

5 250 65.20 48.16 51.25 

('la.si,s C'uvariance 


1 

1 \H 

.K4 

»2 26 


M 

2 05 

1 2H 


"2,26 

l,2K 

K.43 

2 


4t^ 

■',23 


,40 

1.30 

-JO 


“.23 

%10 

I.7H 

3 

17,25 

l!3M 

63)9 


!I,0! 

17.32 

103)1 


63W 

103)1 

11.6.5 

4 

7 m 

i.H3 

LII 


I.K3 

6.37 

1.42 


I.II 

1.42 

2M 

5 

3.03 

2.23 

-I..33 


2.23 

4.20 

-..3B 


-1.33 

-..3K 

H.91 


Divergence 

Matrix 


('I.A.S.SH.S 

<’I.AS.5I-;.S 12 5 4 5 


1 0 864 707 465 475 

2 8f>4 0 2058 462 46 

5 707 2058 0 205 004 

4 465 462 205 0 515 

5 475 46 004 315 0 


The Average Divergence Value = 740 

Transormed Divergence Matrx 


CLASSES 

CLASSES 12345 


1 0 100 100 100 100 

2 100 0 100 100 99 

3 100 100 0 100 100 

4 100 100 100 0 100 

5 100 99 100 100 0 


The Average Transformed Divergence Value = 99 



1 128 128* " 100. DO 

nx Tci^orr Cfciss ! 


2i 143 

64 

44.76 


.. . . JUU:.UU ! 

: 2 

159: 150i 94.341 



3 

352 

. 352 

100.00 


3 

408? 404 

W.02! 



4 

tgf— — j- 

111 

111 

100.00 


4 

no 

no 


^ 

4 


^ 5 

333 

180 



5 

363 

363 

100.00 



5 


Total 

1067 

835 

78.26 


Ifotol 

1440 

1427 

99.10 
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Pixels 

Cor^Pix 

%Corr 
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Pixels 
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1 

282 

282 

100.00 


■■H 


— 




] 


2 

371 

316 

85.17 


2 

■KSD 


86.25 
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3 

311 

311 

100.00 


3 
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! 

100.00 



3 


4 
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208 

■■iQ 


4 

364 

1 

%m 



4 


S'' 

426i 
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5 
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5 

TEST ! 

Total 

1 

■■ESS 



Totol 
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1 

4897' 

4897 

100.00 


1 

400 

4X3 

100,00 

. 138 

138 

100.00 


2 

212 

212 

100.00 


2 

■Hi 

153 

94.44 

257 

257 

mgESm 


3 

■mi 

■mi 

■uSESi 


3 

409 

4)5 

99.02 

1077 

1077 

100.00 


jj^EK! 

■mi 

■D^l 

■EESH 


4 

118 

118 

100.00 
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' . 191 

94.09 


5 

249 

249 

100.00 


5 

367 

367 

■E3u! 

5096 

5084 

99.77 


Total 

6867 

6867 

mBSSm 




1443 
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IE21S31' 
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■■I 
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Ooss 

Pixels 
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WKESEH 


1 

2^ 

—Ea 
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■■■ss 
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2 

371 
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69.81 


2 
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■■ID 

■dSi 

311 

293 

■ESI 


3 
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94.21 


3 

311 

311 

100.00 
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■■ESi 

■KEEI 


4 
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364 

100.00 


4 

364 
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%.62 
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■■ESI 



5 

426 

413 


!■■■ 

5 

426 
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84.62' 

1754 

1628 
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1754 

1611 

91.65 


Total 
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1623 
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Pixels 
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t: 

400 

400 

100.00 

1 
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5044' 

10000 


2 

162 

153 

94.44j 

2 

212 

212 

lOOOO 


3 

409 

405 

99.02 

3 

283 

m 

ioaoo 


4 

118 

118 

100.00 

4 

1226 

\22iS 

100.00 


5 

367 

367 

100.00 

5 

2^ 


lOOXXl 


Total 

1456 

1443 

99.11 
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ms 

lOOOO 
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Pixels 

Cor_Pix 

%Cofr • 

Closs 

Pix^ 

Cor^Pk 
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l1 

282 

282 

^ 100.001 

n 



lOOyQO 


2 

371 

311 

3inooj 

21 

m 




3 

311 

311 

311.001 

3 

311 


97.74 


4 

364" 

360 

360-001 

4 

364 

364 

100.S 


5 

426 

362 

362X)0l 

5 

^61 

96.94 


Total 

1754 

1646 

92jm 

Totol 

ITSS 

9170 


Table 3.15 Classwise Classification accuracy with different techniques on the Singrauh Image. 












Plate 3.1 The growth of training area by seed pixel method in the marshy 
region of Bhopal Image, the white region indicates the seed pixel 
specified by the user. 

This plate emphasizes that in a heterogeneous classes like marshy 
area the conventional technique of training area delineation is 
tedious and may be unrepresentative too. 
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Plate 3.2 ClassiOed image of Bhopal using traditional training area. 
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Plate 3.3 Classifled image of Bhopal using training area generated by seed 
pixel algorithm. 
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Plate 3.5 

Classified image of Bhopal using traditional training area, 
with Buttner’s refinement technique applied on it at k=2. 

The classification results are much better visually than at k=l. 
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Plate 3.6 Classined image of Singrauli using training area generated by seed 
pixel algorithm. 
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Classified image of Singrauli using traditional training area, 
with Buttner’s refinement technique applied on it at k=l. 



Chapter 4 


CONCLUSIONS AND SCOPE FOR THE 

FUTURE WORK 


4.1 Conclusions 

Training area Nelcction and refinement is considered to be an important part of the 
Mi{X'r\ ised classification procedure, as it affects the overall classification accuracy of the 
classifier. Obtaining a representative class accurately and efficiently has been the major 
goal of this study, which has been attempted by the refinement of traditional data and by 
applying alternate methtxls of training area selection.. 

The inijx^tus for the development of non-traditional approach to training field extraction 
grew out of the increasing evidence of the inadequacy and inefficiency of traditional 
training approaches when applied to higher resolution data. A novel technique, termed the 
seed pixel method, of training area extraction was envisioned as a means for improving 
both the efficiency and consistency of training field extraction for images with high 
resolution and high spectral variability. It was designed to increase the degree of 
automation of training field extraction, thereby significantly reducing analyst time 
requirements, while maintaining acceptable levels of accuracy. It is viewed as a potential 
replacement to other non-traditional image analysis techniques. 



I he basic .jppioach used in the thesis was to apply two levels of classification strategies, 
one h) classify ing the images by selecting training areas by conventional methods and by 
seed pixel algorithm methtxl. And the second, by classifying the images after refinement 
suggested h> Butlner et al. { 198K) and Mather (1987). The classified images generated 
from these- methods are then compared to the test areas (delineated on the basis of 
lo{H>graphic maps, published by the Survey of India). Finally, the accuracies of these 
classifiers have been compared by generating confusion matrices. 

On the basis of the above experiments, the following conclusions may be drawn: 

A. 'I'he Seed Pixel approach to training area extraction 

I . Accuracy 

The following trends were observed for various classes and overall accuracies: 

(a) Training area classification accuracy using all seed pixel approach is always 
100%. It means that the training area selected by this algorithm are highly 
.statistically separable, which is demonstrated by the divergence analysis of 
the training area too. 

(b) The 100% training area accuracy does not translate into 100% test area 
accuracy by the seed pixel method. However, the performance of the ML 
classifier using training areas from this method is comparable to the results 
of classification using training areas from traditional refinement procedures. 
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It IS concluticd that, by the proper selection of thresholds and window 
si/c, by more experiments, we can expect even better test area 
classification results. 

(c) The applicatimi of refinement techniques on the training area obtained by 
the seed pixel approach, created problems of getting zero covariance 
matrix for some classes. Although, the problem was tackled by retaining 
a few pixels in the data set, so that the covariance matrix did not become 
singular. 

(d) I'he traditional training areas selected by this method gave high overall 
classification accuracies. It means that most of the classes were highly 
separable. The training area selected by the seed pixel method also gave 
good results. But, the point to be noted is, it worked very well where 
traditional methtxls failed. In both the study sites, the traditional technique 
gave low classification accuracy for natural heterogeneous classes i.e. 
forests and rwky terrain. The seed pixel algorithm increased the 
classification accuracy of these classes. Hence it can be concluded that the 
seed pixel method is specially useful for classification in heterogeneous 
environments. 

2. Efficiency 

The time requirements for the training data extraction and analysis phases of the 
procedures are markedly reduced with the non-traditional approach for both the 
study sites. The relative simplicity of implementing the non-tradioonal approach 
wa, a further advantage in thU context. Use of the new procedures was 
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siraighiforttard. requiring very little prior knowledge of the techniques for 
paiiuneier sjx-citication and permitting substantial reductions in the number of 
rcfKtUivc decisions required of the analyst. Features of irregular shapes, and those 
ha\ ing holes in it can also he selected by this method, which is not possible by 
traditional methirds. 


B. Refinement Procedures 

I. Statistics upgrading technique 

Thi.s technique propo.sed by Mather (1987), gave marginal improvements 
compared to the accuracies obtained for the unrefined data. Since, the unrefined 
data accuracies very high, more increase in accuracy by statistics upgrading is not 
very probable. This will need more inve.stigations to prove its utility for training 
data a'finemcni. 


2. Pixel Removal Technique 

This method proposed by Buttner et al. (1988) showed marked changes in the 
training area statistics after refinement. The main observations from the 
experiments performed are; 

1 . The divergence values increase by application of this technique. This means 
better separability between classes, less confusion and hence better accuracy of 
classification. 
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2. 1‘tic incllHxi gave impnn'ed results at k=2, when the number of pixels retained 
IS suit icient emuigh to just characterize the whole class. 


It can he concluded that this technique gives marked improvement in classification 
accuracy, which is supported by the ob.servation of increasing divergence with 
refinement. The k=2 value gave better re.sults for most cases, hence this value is 
high!) iccoininendcd for refinement. 

Hence it can lx* said that the seed pixel algorithm is an efficient and excellent method for 
iniproveii truing area extraction. The Buttner's technique of refinement gives better 
accuracy results than the unrefined data. It is strongly recommended these methods be 
used in classification prtx'cdure and be incorporated in image processing systems. 


42 Future Directions of Work 

More tests on images of different cover types are recommended to gain better 
understanding of the refinement procedures. This method should be experimented upon 
data of different .spatial resolution to check its effectiveness. If the normality condition is 
followed in the data set or not, remains to be checked. 

Although not specifically demonstrated in this study, one of the biggest advantage of seed 
pixel algorithm may be its potential for integration with existing GIS processing 
capabilities and data-bases. Seed pixel coordinates, and conceivably even certain data 
extraction parameters, could be derived from existing GIS data layers (e.g., the size and 
broad cover categories of potential training areas could be extracted from GIS data and 
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used u> SCI uuiMimiin ticlci si/c and threshold parameters for the seed pixel algorithm). 
I sing the (IIS input, the sect} pixel approach could be u.sed for general land cover 
classification tor an entire region or to .statistically characterize spectral information at 
specific liK-ations within a region for change detection .studies. 
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